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- ABSTRACT 

The fault location model under investigation consists of an 
n -component series system known to have exactly one failed component. 
Component positions in the system are taken as fixed. A component is 
either working or failed. Components work or fail independently of 
each other, with their a priori reliabilities taken as given but not 
necessarily equal. Group testing to locate the failed component is 
sequential, binary and dichotomous in nature with certain results. 

The only costs are the number of tests made. The three solution 
procedures investigated are (1) a dynamic programming formulation, 

(2) a sequential halving procedure, and (3) a procedure based on 
information theory. The criteria for optimality are minimization of 
the expected number of tests required and minimization of the maximum 
number of tests required. 
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I. THE GENERAL FAULT LOCATION PROBLEM 



A. PROBLEM STATEMENT 

The most general form of the fault location problem may be stated 
as follows: One is given a population consisting of individual 

elements. This set is partitioned into two disjoint and exhaustive 
subsets. The problem posed is to specify procedures designed to 
locate in an efficient manner those elements belonging to the first 
subset. 

The property which distinguishes those elements of the first subset 
is connected with some sort of deficiency or fault in most applications, 
hence the term "fault location problem", 

B. DISTINGUISHING MODEL CHARACTFR T STICS 

The general fault location problem encompasses many specific models, 

1 , PopulationNSjze 

Model population size is either finite or countably infinite. 

The assumption of an infinite population can simplify calculations in 
many instances, 

2, Number of Defectives Known to Exist 

"Number of defectives" here is equivalent to the cardinality 
of the first subset in the general formulation. This number is generally 
taken at the outset of the problem to be either completely unknown, one 
or more, exactly one, or unknown but greater than some specified number. 

3, Probability of Elements Being Defective 

The a priori probability of being defective is given for each 
element. With no information as to the number of existing defectives 
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each element is defective with this probability, independent of the 
state of other elements. Information on the number of existing defec- 
tives yields a posterior probability of being defective for each 
element given this information. These posterior probabilities are not 
independent, 

4. Test Outcomes 

A test is an action taken to identify elements belonging to 
the defective set. Tests may result in binary outcomes, i.e., pass/fail 
where these terms are appropriately defined; or they may result in 
multiple outcomes. 

5. Certainty of Test Results 

Test results may be certain, i.e., indicate the true state of 
nature; or they may be uncertain, in which case probabilities of 

Prrrmerm q t outCQ!T!0 Q 0^0 Sp0Cifi9d„ 

6. Number of Elements Included in a Single Test 

The number of elements included in a test may be one or more, 
the latter termed group testing. 

7 . Test Costs 

Test costs are either assumed to be equal for all tests, or 
unequal and specified. Costs are measured in terms of the appropriate 
scarce resource, e.g., time, money, etc. 
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II. OVERVIEW OF WORK IN FAULT LOCATION PROBLEMS 



The following discussion of work which has been done in the general 
area of fault location problems is not claimed to be either an exhaus- 
tive enumeration of all such work or a summary of all the results 
achieved in the papers mentioned. Rather, it is intended to give the 
reader an appreciation for the scope of the general problem, a brief 
description of some of the work which has been done, and an idea of 
just where the model of this thesis fits. 

The first work in this area is generally attributed to Dorfman [7] 
in 1943. The problem he considered was involved with the requirement 
levied by World War II on the Public Health Service and the Selective 
Service System to weed out syphilitic men from the large number of 
incoming inductees. Blood samples were tested using the " Was serman -type" 
blood test which detects the presence of a syphilitic antigen. Prior to 
Dorfman 's efforts, blood samples were tensted on an individual basis, 
requiring a large effort on the part of laboratory personnel. Dorfman 
found that one could pool the blood samples from a number of men and 
test this pooled sample. If none of the men was infected, the entire 
group could thus be passed with a single test. The blood sample drawn 
from each man was sufficient to conduct two tests. The remaining blood 
for each member of an infected group could thus be tested individually 
to identify the infected member(s). Dorfman considered the population 
of inductees to be infinite. He established optimum group sizes and 
relative expected test costs (as opposed to individual sample testing} 
for selected a priori probabilities that any member of the population 
would be infected. This became known as the "blood testing problem". 
Dorfman 's work showed the advantage of group testing to be inversely 
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related to the a priori probability of infection, with the break-even 
point occurring at a probability of about 0.15. He considered the tests 
to be binary in nature with certain results. 

In 1960, Ungar £25] expanded on Dorfman and others' work on the 
blood testing problem. He considered the population to be of finite 
size n, each member with the a priori probability p of being infected. 
His results show that the range of p for which group testing is 
advantageous is 0 <_ p < 1/2(3 -VTf) ^ 0.38. Ungar's group testing 

allows grouping of individuals for all tests. 

Finucan £8] in 1964 also extended the results of Dorfman in an 
algebraic treatment for Dorfman 's two-stage method (group testing at 
the first stage, then individual testing at the second), and also for 
methods using three or more stages. As in Dorfman's work, Finucan 
assumes thp nooulati^n to hs infill t9 v/ith ssch member h e v i n c er oceel 
prior probability of being infected. As in Dorfman and Ungar, minimi- 
zation of the expected number of tests required is the criterion adopted 
for optimality. 

Sobel and Grol 1 £21 ] in 1959 also extended Dorfman's original efforts. 
In their model the population size is finite, the number of elements in 
each group test is not necessarily constant, and if a group test fails, 
each element is not necessarily tested individually. Several procedures 
are developed with conditions for their optimality under ranges of p 
values, The criterion used is the expected number of tests required to 
eliminate all defectives. Several industrial applications are also 
cited. This work was extended by Sobel £20,23] in 1960 and 1964. Kumar 
and Sobel £24] considered a variant of this model in 1970. They begin 
with an infinite population, each of whose elements has an equal prior 
probability of being defective. In this model an optimum group testing 



procedure is obtained in the sense that it minimizes the expected 
number of tests required to find the first defective. 

Black [1] in 1965 formulated a search model in which the finite 
population consists of "regions" in which a single target may lie. A 
test consists of a "look" in a region for the target. The binary 
results of these tests are uncertain in that each region is assigned 
m.j , a conditional miss probability, i.e., probability that given the 
target is in the i^ 1 region, it will not be detected on a single look 
there. Each region is also assigned a prior probability that the 
target is there (p^)? and a cost per look (c.). His solution requires 
the computation of a figure of merit, p^(l-m^ » for each of the 

i regions and for as many of n looks as desired. These values are 
placed in a two-dimensional array (by n and i). The order of search 

q-F thp ^m'nnc nc q rjpA 1 nn ov^rjpv- n-f f hoi' ^ *F 1 f! U c - Qf J]]P K* "i f RlnrL' 

also derives a means for calculation of the expected cost of the search. 
His model is equivalent to individual element testing with the cost of 
searching each region independent of the search effort previously 
expended in other regions. He references Matula [16], a student of 
Blackwell, who originally drew upon the results achieved by Blackwell [2] 
in his "bal 1 -in-box" problem. Klein [5] in 1967 also formulated a 
search model involving a single target to be located, which employs 
Markovian decision models. 

Gaddess £6] addressed in 1969 a related problem for which very few 
results have been obtained, His work concerns the specification of test 
points within a modular combinational logic circuit with the objective 
of insuring diagnosabil ity to the module level of the overall circuit, 
i.e., insuring that there exists at least one sequence of binary test 
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inputs which distinguishes any two single faults in separate modules. 

He derives three techniques for allocating test points: (1) A method 

analogous to the prime implicant covering problem of classical switching 
theory, (2) a graphical worst case analysis, and (3) a combination of 
the first two methods. 

Zimmerman £26] in 1959 investigated a model in which the population 
is finite with exactly one defective element. Each element has a known 
(but not necessarily equal) probability of being defective. Testing is 
binary with certain results. Each test partitions the elements into 
two groups; the test outcome reveals which group contains the defective 
element. This group then comprises the elements for the next test. 
Testing is complete when the defective is found. Optimality is judged 
on the expected number of tests required. Zimmerman views the problem 

at; y'onop-f romKinaf i on q -f -r^O rv 1 r\ +■ r» -> r* Op r )^*'I3CCi ^"0 ^ ^ d "! V i C H 

His results involve the combination at any stage of the two elements 
having the smallest prior probabilities. These results appear to the 
author to be equivalent to a coding procedure developed by Huffman £12] 
in 1952. 

Sandelius £19] in 1961 examined a particular case of the model 
previously treated by Zimmerman. Sandelius* model assumes that all 
elements have an equal prior probability of being defective. Testing 
is as described above for Zimmerman. To state Sandelius* theorem, we 
define the following: 

n = m. = 2^° + r , 
o o 

where n = number of elements to be tested 

m.j = number of elements remaining to be tested after i tests 
have been conducted 
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k. e {0,1,2,...} 

r. e {0,1,2,..., (2 k i - 1)} 

Sandelius proves the following theorem: When all p. are equal the 
minimum expected number of tests is k Q + (2r /n), and this will be 
attained if and only if the number of elements of each of the two 
groups which are tested in the (h + 1)^ test (h = 0,1,2,...) belongs 
to the closed interval £2*^"^, 2^h], 

Johnson [18] in 1956 couched his models in terms of electronics 
equipment to be checked out. His population is finite and considered 
from two related levels. In the first, the population is composed of 
the electronic components which form the system. The second level 
population consists of the individual parts of which each component is 
composed. Sequential binary testing with certain results takes place 
on the components level first, then on the parts level of a located 
failed component. On each level elements are tested individually. 
Components and their associated parts are assigned prior probabilities 
of failure, and required test times (broken down further into the sum 
of the time for removal for testing, the time for the actual test, and 
the time for replacement). Optimum test sequences minimize the expected 
delay time, measured from the time the system is initially tested to the 
time it works. Johnson considers both multiple failures in the system, 
and the case of one failure. 

Gluss [10] in 1959 considered a model equivalent to Johnson's case 
of exactly one failure described above, with the exception that test 
results are no longer certain. Attached to each element is a conditional 
probability that a single test of that element will fail to indicate 
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failure, given the element has actually failed. Firstman and Gluss [9] 
in 1960 expanded Gluss' model to include "false alarms", i.e., tests 
which indicate failure when no failure has occurred. 

Butterworth [4] expanded the results of Johnson to examine specific 
types of systems. His models treat optimum sequential binary testing 
with certain results of individual components from a finite population. 
Each component's prior probability of failure and the time required to 
test it are known. The systems treated are the k-out-of-n type (k/n), 
i.e., the system works if and only if k or more of its components 
work. The series (n/n) and parallel (1/n) systems are included as 
special cases. In his first model a feasible testing procedure must 
determine the system state, assuming the components to be independent. 

In other models for which it is assumed that the system has failed, a 
feasible tpct-jnq procsdtir^ iryjst locate ^11 fuilod comn orients. To^’Mrin 
procedures are judged in terms of the expected time required to complete 
testing , 

Brul£, Johnson and Kletsky [3] in 1960 investigated models phrased 
in the electronics system form. The individual components compose the 
finite population. They consider first a model allowing multiple 
component failures. Their goal is to construct a general testing diagram 
to show in node and arc form the successive system states, as represented 
by binary n-^tuples, and the sequential tests to perform in locating the 
failed components. They conclude that even simple systems can require 
extremely complex testing diagrams, but that this requirement may be 
reduced to tractable proportions if the allowed number of failed 
components is reduced to exactly one. Their resulting testing diagram 
constructions are then based on this stipulation. They also examine 



sequential binary test procedures for two special cases. For both cases, 
testing is performed as described above for Zimmerman. The first 
special case, is termed the equal cost-equal probability case, in which 
the prior probabilities of failure and test costs for all components are 
equal. They cite a procedure termed the "half-split technique" which 
is equivalent to that described above in Sandelius' work. In this case, 
this procedure leads to an optimum solution in terms of minimizing the 
exptected cost of testing. For this special case, they claim that this 
procedure is a minimax solution, i.e., it minimizes the maximum possible 
cost. They further claim that it yields the minimax solution when the 
probabilities of failure are unequal. The author refutes both these 
claims. A counterexample is attached at the end of Appendix C. Their 
second special case is the equal cost-unequal probability case. They 
show an analogy between this situation and that described by Huffman [! 9 ] 
in his optimum coding problem. To employ Huffman's procedure the compo- 
nents must be arrangeable in order of decreasing reliability, thus one 
must be able to group them in this manner under the testing procedure. 

Kletsky [153 in I960 expanded on both the work mentioned above by 
Brul6, Johnson and himself and that of Johnson [13]. He shows an example 
of the application of a figure of merit based upon information theory in 
the formulation of a testing diagram corresponding to an "efficient" 
sequential test procedure. The example system is the power supply of a 
standard USAF communications receiver. Estimation of posterior probabili- 
ties of failure given that the equipment has failed for each component is 
shown through a frequency analysis of the equipment failure history. 
Implicit in these calculations is the assumption that any equipment 
failure results from exactly one failed component. The figure of merit 
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representing the ratio of ambiguity removed by the k^ test to 
the cost of performing the test, is as follows: 



F 



k 



-Plog 2 P - (l-P)log 2 (l-P) 

9 




where P is the probability that the test will pass and is the cost 
of performing the test. Kletsky's procedure is as follows: 

1) Evaluate for each of the possible tests. 

2) Choose the test with the largest F^. 

3) Alter the cost of performing the remaining tests on the basis of 
having performed this and other previous tests. 

4) Alter the probability of passing for each of the remaining tests 
on the basis of knowledge gained by having performed this and 
other previous tests. 

5) Repeat the procedure until the entire sequential testing diagram 
is determined. 

As an indication of the "efficiency" of the above-described procedure, 
Kletsky offers only the statement that "...the information theory tech- 
nique yields a diagnostic procedure which is not essentially different 
from that which would be used by a competent technician". 

Kovacs £11] in 1968 expanded on Kletsky's work. He derives an 
equivalent figure of merit for multiple outcome tests which reduces to 
the above form for binary tests. He also discusses the use of multiple 
outcome versus binary tests, and presents a method for the incorporation 
of multiple outcome tests on a binary test diagram. In evaluation of 
the information theory figure of merit approach, Kovacs states simply, 
"...this approach opens the door to... the most rapid and efficient 



checkout procedure." 



III. MODEL DESCRIPTION 



A. SYSTEM 

The population under investigation in this model can be described 
as a series system of a finite number of components. In terms of the 
system descriptions used by Butterworth [4], it is an n/n system in 
which the system works if and only if all its components work. If the 
system does not work, it is said to be failed. The system is most 
easily visualized as an electronic system with a single signal path, 
as shown in Figure 1 . 



input 





output 



An n-Component Series System 
Figure 1 



B. COMPONENT ATTRIBUTES 

Component positions in the system are taken as fixed, such as in a 
series resistor network. As a convention, the system is as shown in 
Figure 1, with the input to the left and the components numbered sequen- 
tially from left to right. 

A component may be in one of two states, i.e., working or failed. 
Components work or fail independently of each other. The a priori 
probability, p° for i = l,2,...,n, that a component is working is taken 
as given, but not necessarily equal for all components. This probability 
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is sometimes called the reliability of the component, and may be 
expressed as the probability that the component will perform satis- 
factorily throughout the duration of some specified mission. The 
determination of these probabilities is not considered here. 

The system is assumed initially to have exactly one failed component. 

C. TESTING 

Testing is to be sequential, binary, and dichotomous in nature with 
certain results. It is dichotomous in that each test partitions the 
set of components known to contain the failed component into two subsets. 
It is sequential in that the outcome of any test will determine the next 
test to be conducted, thus the result of each test is evaluated prior to 
conducting the next test. Testing is binary in that only pass/fail 
results are obtained. The only costs are the number of tests made. We 
may Liiink of the tests being conducted as testing across a number of 
resistors for continuity using an ammeter with one probe of the ammeter 
fixed at the left end of the system. A test across the first two 
components is shown in Figure 2. If this test "passes", it indicates 
continuity through components 1 and 2, indicating that the failed 
component lies to the right of component 2. If the test "fails", it 
indicates no continuity through the first two components, thus one of 
them must be failed (since test results indicate the true state of 
nature). "Failed" in this context is equivalent to "open" in the 
electrical sense. 




Testing Across Components 1 and 2 
Figure 2 
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Suppose the test in Figure 2 passes. Then the next test might be 
say as shown in Figure 3, where the set of components 3 through n is 
partitioned into sets consisting of components 3 through 5, and 6 
through n. If this test fails, the failed component is now known to 
be either component 3, 4, or 5; and if it passes, the failed component 
is now known to lie to the right of component 5. 




Testing Across Components 1-5 
Figure 3 

This sequential testing scheme requires a decision of where to place 
the right hand probe for each succeeding test, based upon the results of 
all previous tests. To specify any particular solution, these decisions 
must be specified for both pass and fail results for each test. The 
number of tests required to locate the failed component will be a 
random variable, depending on the test plan adopted and the component 
which has actually failed. We will let N represent this integer- 
valued random variable, and denote its expected value by E(N). 

Utilization of our testing procedure will result at any point in the 
set known to contain the failed component being composed only of compo- 
nents adjacent to each other, such as components i through j, i <_j. 
We shall use this fact to describe the system's state at any point in 
the testing procedure as follows: Let S(i,j) indicate that components 

i through j inclusive comprise the set known to contain the failed 
component. Then let d(i,j) = k indicate the decision to test across 




the first k components when the system state S(i,j) is realized. 

Note that k g {i ,i+l , . . . ,j-l} . Further, if this test passes, we have 
S(k+l,j), and if it fails S(i,k). Testing is complete when we reach 
S(i,i) for some i, for then component i is known to be failed. 

Diagrammatic representation of a derived test plan solution is best 
represented in the node-arc form as shown in Figure 4. In this repre- 
sentation, the rectangular nodes show sequential system states which 
may result throughout the procedure and their associated decision 
variable values. The circular nodes indicate the located failed 
component. This representation shows all possible paths through the 
procedure, each terminating with the location of the failed component. 
For example, suppose component three is actually the failed component. 
The test across the first four components fails, resulting in state 



^(] Tho novf facf arwr^rc -rUe* fi'v»C+ +-hv^ry 
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resulting in state S(l,3). The third test across the first two 
components passes, indicating component three to be failed (the terminal 
state S(3 ,3) ) . Thus, three tests are required under this procedure to 
locate the third component. 

For purposes of compactness, we wish to reduce the diagram of 
Figure 4 to tabular form. An equivalent procedure is depicted in 
Table I. The "TEST" and "STATE" columns are self-explanatory. The "DEC 1 
column denotes the decision corresponding to the state to its left. The 
"COMP" column denotes the component(s) which, if failed, would be 
located by the test. This tabular form will be utilized to describe 
solutions to example cases. 
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Sample Test Plan for 10-Component System 
Figure 4 



® 

pass 



S(7,8) 

d*(7,8)=7 



fail 

L<d 



STAGE 5 



21 



TEST 


STATE 


DEC 


COMP 


1 


1 ,10 


4 




2 


1, 4 


3 


4 




5,10 


6 




3 


1, 3 


2 


3 




5, 6 


5 


5, 6 




7,10 


9 


10 


4 


1, 2 


1 


1, 2 




7, 9 


8 


9 


5 


-^1 

V# 

00 


7 


00 



Tabular Form of Test Plan 
TABLE I 

D, OBJECTIVE 

Our objective is to examine several solution procedures based on 
the following criteria ior optima i ity : 

1) Minimization of the expected number of tests required. 

2) Minimization of the maximum number of tests required. 

Minimization of the expected number of tests required is the cri- 
terion most frequently encountered in the literature. Implicit in the 
use of such an expected value criterion is the assumption that testing 
is to be repetitious, yielding good results over the "long haul". In 
many cases, the results of any one realization of a system test may be 
disastrous in terms of the number of tests actually required. To 
hedge against this kind of disastrous realization, one may instead 
employ the criterion of minimizing the maximum number of tests required 
to locate the failed component. This is termed a "minimax" criterion. 

Of course, if one could devise a testing procedure which would be 
optimum in terms of both criteria, he might then consider the procedure 
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to be ideal. In general, however, one would expect that tradeoffs 
would exist between the two. In the practical sense then, one must 
examine the attributes of alternative solutions in order to choose the 
one which best suits his needs. 

We will examine three procedures. The first procedure involves 
the solution of a dynamic programming formulation of the problem. 

This results in a test plan which minimizes the expected number of 
tests required. 

The second procedure, termed the sequential halving procedure, 
is shown to minimize the maximum number of tests required. 

The third procedure, termed the information theory approach, is a 
heuristic procedure based upon maximizing the expected reduction in 
the uncertainty of the failed component's location at each succeeding 



T U n ^ r\ ia rv rv aI i i a r* a 4- a 1 a •! an 4- /\ U. an a *n 4* ^ m i 
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criterion, yet its ease of computation suggests it to be worthy of 
investigation. 
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IV. MODEL SOLUTIONS 



A. DYNAMIC PROGRAMMING FORMULATION 



1. Nomenclature 



1 1 



number of components which comprise the system, 
probability that component i is failed, given that 



the system is failed with exactly one failed 
n 

component. E q. = 1. 

i=l 1 

S(i,j) = system state denoting that the failed component is 
known to be one of the components i ,i+l , . . . ,j-l ,j . 
Note that i <_ j . 

Qj, (i,j) = minimum expected number of tests required to locate 
the failed component beginning in state S(i,j) and 
testing across the first k components on the next 
test. Note that k e (i ,i+l , . . . ,j-l }. 

, k = i ,i+l ,. . . ,j-l . 

k denotes the decision to test across the first k 
components on the next test, beginning in state S(i,j). 
d*(i,j) = the decision at S(i,j) which results in f(i,j), i.e., 
the optimal decision at S(i,j). 



f(i.j) = 
d(i,j) = 



7 Q k (U) 



2. Stage 

We shall define the stage of the problem in terms of the system 
state. From the testing description in Section III, it follows that 
all possible system states can be enumerated in terms of the stage 
variable s as follows: S(i,i+s) for i = l,2,...,n-s and s = 0,1 , . . . ,n-l . 

We shall let the stage correspond to the number s, so stages are 
numbered from zero to n~l , and at each stage s the possible system 
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states are S(i,i+s) for i = l,2,...,n-s. For example, at stage zero 
the possible states are S(1 ,1 ) ,S(2,2) , . . . ,S(n,n) . At stage three the 
possible states are S(l,4), S(2,5),..., S(n-3,n). Finally, at stage 
n-1 the only possible state is S(l,n), which corresponds to the system 
state prior to any testing. The procedure to be employed is termed 
"backward recursive optimization" by Nemhauser [17]. Thus, while 
actual testing proceeds from stage n-1 to stage zero, solution of the 
problem begins with stage zero and works back to stage n-1. 

3. Decision Variable 

The decision variable at any state S(i,j) is 
d(i ,j) e fi .1+1 >• • • ,j-l }• 



4. Objective Function 



The objective is to minimize the expected number of tests 



Find f (1 ,n) = m J. n [Q k (l ,n)] = min E(N) . 

5. General Recursive Equation 

Let the system be in state S(t,m) at stage s = m - t. Then 
the general recursive equation is as follows: 

f (t,m) = m k n [Q k (t,m)]» k e {t,t+l ,. . . ,m-l }, 
where Q k (t,m) is calculated as follows: 

Q k (t,m) = P[1 + f ( t , k ) ] + ( 1 -P) [1 + f (k+1 ,m)] , (1) 



where P 



k 

E q. 
i =t 1 
m 

S q. 

i=t 1 



Note here that P is the probability that state S(t,k) results from 
this test and [1 + f ( t , k ) ] is the minimum expected number of tests 
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required for completion of testing should S(t,k) result. The second 
term in (1) is similarly interpreted. 

6. Initial Conditions 

As we have stated above, testing is complete when the system 
state is S(i,i) for some i , since we then know component i to be 
failed. Thus f(i,i) = 0 for i = 1,2 n. 

At state S(i,i+1) we have only to make one further test, thus 
f(i,i+l) = 1 , and d*(i,i+l) = i for i = l,..,,n-l. 

7. Solution Procedure 

With the posterior probability of failure q. given for each 
of the system's n components and the f values corresponding to all 
possible system states at stages zero and one given as shown above, 
begin with stage two. For each of the possible system states at stage 

4-. . «i-v ,..Un ~ U -v ~ £ -i- U ^ C ( A A lO \ 4-1 vx O ~ 1 . 1 4-~ 

^ Mills'll vai ^ u « ».m. iiyin, . i i | * i • » , # i , i . >.u i i ii . u 

Q k (i,i+2) for k = i,i+l. For each state S(i,i+2), f(i,i+2) = ^[(^(i ,i+2)] , 
where Q^(i ,i+2) is calculated from (1). With each state S(i,i+2) 
associate the optimal decision variable d*(i,i+2) which yields f(i,i+2). 

Continue similarly for subsequent stages. Upon completion of 
stage n-1 , a value for f(l,n) has been obtained. This is the minimum 
expected number of tests required to locate the failed component. 

For the complete specification of the derived test plan, trace 
back through the stages and their associated d* values along 
sequential testing paths which terminate with state S ( i , i ) for all i. 

8. Computer Program 

A computer program, written in FORTRAN IV for use on the 
IBM 360-67 digital computer has been developed and used in the example 
cases included in Section V. A program listing and sample output is 
included following Appendix C. 
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B. SEQUENTIAL HALVING PROCEDURE 



The sequential halving procedure is independent of the probabilities 
of failure attached to the system components. It can be described as 
follows: At any point in the procedure if m components remain to be 

tested, the next test should divide them as equally as possible. Thus, 
if m is even, the next test divides the components into two equal 
groups of m/2 each. If m is odd, the next test divides the components 
into two groups with m/2 - 1/2 in one group and m/2 +1/2 in the 
other. For consistency, we will always take the smaller of the two 
groups to the left, e.g., if components 1-7 remain to be tested, we 
test next across components 1-3. 

It is shown in Appendix C that this procedure is minimax. In the 
special case where the component probabilities of failure are all equal, 
this procedure satis fiee the requirements of Sanriciius 5 theorem given 
in Section II, and thus also yields the minimum expected number of 
tests required. In other cases, the expected number of tests required 
may not be minimized through this procedure. 



C. THE INFORMATION THEORY FORMULATION 

The information theory solution to the problem is a heuristic 
approach, based upon maximization of the expected reduction of uncertainty 
inherent in the system at each succeeding test. This procedure was 
mentioned in passing as a special case by Brule, Johnson and Kletsky [22] 
in 1959. 

The procedure may be simply stated as follows: Suppose the failed 

component is known to belong to a set of m components. The component 

posterior probabilities of failure given that one of the m components 

m 

is failed, q., are known with Z q. = 1. Test next across the first 

1 i=l 1 



k 

k components, choosing k such that I j q. - 1/2| is 

i = l 1 

a minimum. 

A derivation of an expression for the computation of component 
posterior probabilities is contained in Appendix A. A derivation of 
the information theory procedure and an algorithm for its use are 
contained in Appendix B. 

The attributes of the information theory solution in terms of the 
two criteria for optimality listed above is unclear, except to assert 
that the expected number of tests required will be at least that given 
by dynamic programming, and the maximum number of tests required will 
be at least that given by the sequential halving procedure. Further 
evaluation of this procedure is the purpose of the example cases 
considered in the next section. 



V. EXAMPLE CASE RESULTS 



Figures 5 through 19 summarize the salient features and results 
obtained in seventeen example cases. 



A. KEY TO FIGURES 5 THROUGH 19 



The followi 
N 

E(N) 

V(N) 

N 

max 



ng definitions apply to the entities of these figures: 
the number of tests required to locate the failed 
component. 

the expected value of N. 
the variance of N. 

the maximum number of tests required to locate the 
failed component. 



= the 



HY'l AV'l 






/■' r>m n An a 






q. = the posterior probability component i is failed, 

given that the system has one failed component. 

State = (i,j) denotes the set of components i through j 

inclusive is known to contain the failed component. 

Dec = i denotes the decision to test across the first i 
components on this test. 

Comp column denotes the component(s) which, if failed, would be 
located by the test. 

pmf denotes the probability mass function values for N. 

Complete test plan specifications are shown for both the dynamic 
programming and information theory solutions for all 20-component cases. 
Cases 15, 16 and 17 are 40-component cases, for which only summary 
results are included. 
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B. SEQUENTIAL HALVING TEST PLAN SPECIFICATION 



The sequential halving test plan depends only on the number of 
components which comprise the system and is independent of the a priori 
component reliabilities assigned. 



TEST 


STATE 


DEC 


COMP 


1 


1 ,20 


10 




2 


1 ,10 


5 






11 ,20 


15 




3 


1, 5 


2 






6,10 


7 






11 ,15 


12 






16,20 


17 




4 


1, 2 


1 


1, 2 




3, 5 


3 


3 




6, 7 


6 


6, 7 




8,10 


8 


8 




11 ,12 


11 


11 ,12 




I n 1 r~ 

i 0 3 i 


1 3 


4 *3 




16,17 


16 


16,17 




18,20 


18 


18 


5 


4, 5 


4 


4, 5 




9,10 


9 


9,10 




14,15 


14 


14,15 




19,20 


19 


19,20 



20-Component Sequential Halving Test Plan 
TABLE II 



C. A PRIORI COMPONENT RELIABILITIES 

A priori component reliabilities do not necessarily sum to unity, 
and are therefore not probability distributions. 

Example case 1 is the 20-component equal probability case. 

Component reliabilities are linearly arranged for cases 2 through 5, 
in order of increasing slope. 
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Component reliabilities are symmetric and follow the familiar 
"bell -shaped" curve in cases 6, 7 and 8 in order of increasing 
peakedness . 

Cases 9, 10, 11, 15, 16 and 17 contain component reliabilities 
randomly selected between 0.7 and 1.0. 

Component reliabilities are geometrically arranged for cases 12, 

13 and 14 by P 20 - ( i - 1 ) = ^ or 1 = 1 >2> . . . ,20. The p-values used 

are 0.95, 0.90 and 0.85 respectively. 

D. COMPUTER PROGRAM VALIDATION 

The computer program was validated first by running four and five- 
component cases for which the solution had been calculated manually. 

For 10, 20, 40 and 80-component cases, it was validated by running 
the equal probability case for which the solution is given by Sandelius 1 
theorem stated in Section II. For these cases the E(N) value is 
accurate to at least four decimal places. 

The solution given by the computer program does minimize E(N), but 
does not indicate the existence of alternate optima. Such alternate 
solutions do in fact exist for the equal probability case. Thus, 
where the pharse "the dynamic programming solution" appears, perhaps 
the phrase "a dynamic programming solution" may be more appropriate. 



31 



EXAMPLE CASE 1 



Procedure 



E(N) 



V (N ) 



max 



Comp 



Dynamic Prog 


4.4000 


0.2400 


Info Theory 


4.4000 


0.2400 


Seq Halving 


4.4000 


0.2400 



1.0 J' 





n 1 — 


p 


i 


— r"~ 




1 5 


10 


15 


20 




DYNAMIC 


PROGRAMMING 


Tes l 


State 


r'i/"w - 
L/ O 


Co, Tip 


r \ nn -r 

j-»MI 1 


1 


V# 

ro 

o 


10 




0 


2 


1 ,10 


5 




0 




11,20 


15 






3 


1, 5 


2 




0 




6,10 


7 








11 ,15 


12 








16,20 


17 






4 


1, 2 


1 


1, 2 


.6000 




3, 5 


3 


3 






6, 7 


6 


6, 7 






8,10 


8 


8 






11 ,12 


11 


11 ,12 






13,15 


13 


13 






16,17 


16 


16,17 






18,20 


18 


18 




5 


4, 5 


4 


4, 5 


.4000 




9,10 


9 


9,10 






14,15 


14 


14,15 






19,20 


19 


19,20 





1 


.9000 


.0500 


2 


.9000 


.0500 


3 


.9000 


.0500 


4 


.9000 


.0500 


5 


.9000 


.0500 


6 


.9000 


.0500 


7 


.9000 


.0500 


8 


.9000 


.0500 


9 


.9000 


.0500 


10 


.9000 


.0500 


11 


.9000 


.0500 


12 


.9000 


.0500 


13 


.9000 


.0500 


14 


.9000 


.0500 


15 


.9000 


.0500 


16 


.9000 


.0500 


17 


.9000 


.0500 


18 


.9000 


.0500 


19 


.9000 


.0500 


20 


.9000 


.0500 


INFORMATION 


THEORY 




i uG UCC 


1 -OHTip 


pmf 



(Same sol'n as D. P. ) 



Figure 5 
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EXAMPLE CASE 2 



Procedure 


EiHi 


V (N ) 


N 

max 


Comp 


p? 














1 


.9560 


.0643 


Dynamic Prog 


4.3281 


0.2204 


5 


2 


.9570 


.0628 












3 


.9580 


.0613 


Info Theory 


4.3521 


0.2281 


5 


4 


.9590 


.0598 












5 


.9600 


.0582 


Seq Halving 


4.3811 


0.2399 


5 


6 


.9610 


.0567 












7 


.9620 


.0552 












8 


.9630 


.0537 


1.0- 








9 


.9640 

CiC ITO 


.0522 

r\ r 












1 u 


. 9650 


. 0507 












11 


.9660 


.0492 


„ 










12 


.9670 


.0477 


- 










13 


.9680 


.0462 


- 










14 


.9690 


.0447 












15 


.9700 


.0432 












16 


.9710 


.0417 












17 


.9720 


.0403 


0 








comp 


18 


.9730 


.0388 


1 I 


“ 1 1 “ 


1 1 ^ 


19 


.9740 


.0373 




1 5 


10 


15 20 




20 


.9750 


.0358 



DYNAMIC PROGRAMMING INFORMATION THEORY 



Tes i 


S La be 




» (hum 


pmf 


> * ff> 


Dec 


‘ *~w f i r ' 


prrsf 


i 


1 ,20 


8 




0 


1 ,20 


9 




0 


2 


1, 8 


4 




0 


1, 9 


4 




0 




9,20 


12 






10,20 


14 






3 


1, 4 


2 




0 


1, 4 


2 




0 




5, 8 


6 






5, 9 


6 








9,12 


10 






10,14 


11 








13,20 


16 






15,20 


17 






4 


1, 2 


1 


1, 2 


.6718 


1, 2 


1 


1, 2 


.6479 




3, 4 


3 


3, 4 




3, 4 


3 


3, 4 






5, 6 


5 


5, 6 




5, 6 


5 


5, 6 






7, 8 


7 


7, 8 




7, 9 


7 


7 






9,10 


9 


9,10 




10,11 


10 


10,11 






11 ,12 


11 


11 ,12 




12,14 


12 


12 






13,16 


14 






15,17 


15 


15 






17,20 


18 






18,20 


18 


18 




5 


13,14 


13 


13,14 


.3280 


8, 9 


8 


8, 9 


.3519 




15,16 


15 


15,16 




13,14 


13 


13,14 






17,18 


17 


17,18 




16,17 


16 


16,17 






19,20 


19 


19,20 




19,20 


19 


19,20 





Figure 6 
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EXAMPLE CASE 3 



Procedure 


E ( N ) 


V ( N ) 


N 

max 


Comp 


p? 










1 


.7850 


Dynamic Prog 


4.1446 


0.6213 


6 


2 


.7950 












3 


.8050 


Info Theory 


4.1691 


0.7385 


7 


4 


.8150 












5 


.8250 


Seq Halving 


4.3459 


0.2263 


5 


6 


.8350 












7 


.8450 












8 


.8550 


1.0 ' 








9 


.8650 






. • * 
. , • • 




10 


.8750 






» • * * 


♦ * 




11 


.8850 




f • f * 

• • 








12 


.8950 












13 


.9050 












14 


.9150 












15 


.9250 


- 










16 


.9350 


- 










17 


.9450 


o ' 








comp 


18 


.9550 


1 1 


I 


1 1 * 


19 


. 9650 




1 5 


10 


15 20 




20 


.9750 



DYNAMIC PROGRAMMING INFORMATION THEORY 



£5 t 


State 


L’£C 


Lornp 


pm? 


State 


U 


L-OiTlp 


l 


1,20 


6 




0 


1,20 


6 




2 


1, 6 


2 




0 


1 , 6 


3 






7,20 


10 






7,20 


10 




3 


1 , 2 


1 


1 , 2 


.1878 


1 , 3 


2 


3 




3 , 6 


4 






4 , 6 


4 


4 




7,10 


8 






7,10 


8 






11 ,20 


14 






11,20 


13 




4 


3 , 4 


3 


3 , 4 


.5408 


1, 2 


1 


1, 2 




5 , 6 


5 


5 , 6 




5 , 6 


5 


5 , 6 




7 , 8 


7 


7 , 8 




7 , 8 


7 


7 , 8 




9,10 


9 


9,10 




9,10 


9 


9,10 




11,14 


12 






11 ,13 


11 


11 




15,20 


16 






14,20 


15 




5 


11 ,12 


11 


11 ,12 


.2104 


12,13 


12 


12,13 




13,14 


13 


13,14 




14,15 


14 


14,15 




15,16 


15 


15,16 




16,20 


17 






17,20 


18 












6 


17,18 


17 


17,18 


.0610 


16,17 


16 


16,17 




19,20 


19 


19,20 




13,20 


18 


18 


7 










19,20 


19 


19,20 



Figure 7 



*1 

.0967 

.0911 

.0856 

.0802 

.0749 

.0698 

.0648 

.0599 

.0551 

.0505 

.0459 

.0414 

.0371 

.0328 

.0286 

.0246 

.0206 

.0166 

.0147 

.0091 



o ’ 

0 



.1658 



.6087 



.1399 



.0618 



,0238 
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EXAMPLE CASE 4 



Procedure 


E(N) 


V (N) 


N 

max 


Dynamic Prog 


3.9152 


0.8517 


8 


Info Theory 


3.9152 


0.8517 


8 


Seq Halving 


4.3178 


0.2168 


5 



r 1 

1.0 “ 



u 


— — r 
1 5 


1 

10 


1 

15 


— T - "" 
20 




DYNAMIC 


PROGRAMMING 




• JL 

• N 1 


r -l j- 
o. oc 


PlAr- 




. , r 


1 


~r,To 


5 




0 


2 


1, 5 


2 




0 




6,20 


9 






3 


1, 2 


1 


1, 2 


.3548 




3, 5 


3 


3 






6, 9 


7 








10,20 


12 






4 


4, 5 


4 


4, 5 


.4612 




6, 7 


6 


6, 7 






8, 9 


8 


8, 9 






10,12 


10 


10 






13,20 


14 






5 


11 ,12 


11 


11 ,12 


.1216 




13,14 


13 


13,14 






15,20 


16 






6 


15,16 


15 


15,16 


.0464 




17,20 


17 


17 




7 


18,20 


18 


18 


.0084 


8 


19,20 


19 


19,20 


.0076 



comp 






Comp 


•*? 


1 


.4050 


2 


.4350 


3 


.4650 


4 


.4950 


5 


.5250 


6 


.5550 


7 


.5850 


8 


.6150 


9 


.6450 


10 


.6750 


11 


.7050 


12 


.7350 


13 


.7650 


14 


.7950 


15 


.8250 


16 


.8550 


17 


.8850 


18 


.9150 


19 


.9450 


20 


.9750 



INFORMATION THEORY 



(Same 



sol'n as D. 



Figure 8 



°>i 

.1330 

.1176 

.1042 

.0924 

.0819 

.0726 

.0642 

.0567 

.0498 

.0436 

.0379 

.0326 

.0278 

.0233 

.0192 

.0154 

.0118 

.0084 

.0053 

.0023 



P.) 
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EXAMPLE CASE 5 



Procedure 


E(N) 


V(N) ^*max 


Comp 


p? 












' 1 


.0250 


.4925 


Dynamic Prog 


2.6504 


3.7483 10 


2 


.0750 


.1557 










3 


.1250 


.0884 


Info Theory 


2.6504 


3.7483 10 


4 


.1750 


.0595 










5 


.2250 


.0435 


Seq Halving 


4.1459 


0.1266 5 


6 


.2750 


.0333 










7 


.3250 


.0262 




P? 






8 


.3750 


.0210 


i n 


1 






9 


.4250 


.0171 


1 • U - 






• 


10 


.4750 


.0140 








# 


11 


.5250 


.0114 








• * 


12 


.5750 


.0093 






• 




13 


.6250 


.0076 


- 




• 




14 


.6750 


.0061 


- 




• 




15 


.7250 


.0048 


• 


• 






16 


.7750 


.0037 










17 


.8250 


.0027 










18 


.8750 


.0018 


0 


L-! 1 


r 


— i 1 comp 


19 


.9250 


.0010 




1 5 


10 


15 20 


20 


.9750 


.0003 




DYNAMIC PROGRAMMING 


INFORMATION THEORY 




Test 


State 


Dec 


Comp pmf 


State 


Dec Comp 


nnrF 


*1 

i 


i ,20 


i 

i 


I .4925 








2 


2,20 


3 




(Same 


sol 'n as D.P. 


) 


3 


2, 3 


2 


2, 3 .2441 










4,20 


6 










4 


4, 6 


4 


4 .0595 










7,20 


9 










5 


5, 6 


5 


5, 6 .1030 










7, 9 


7 


7 










10,20 


12 










6 


8, 9 


8 


8, 9 .0521 










10,12 


10 


10 










13,20 


14 










7 


11 ,12 


11 


11,12 .0344 










13,14 


13 


13,14 










15,20 


16 










8 


15,16 


15 


15,16 .0112 










17,20 


17 


17 








9 


18,20 


18 


18 .0018 








10 


19,20 


19 


19,20 .0013 









Figure 9 
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EXAMPLE CASE 6 



Procedure 


E(N) 


V (N) 


N 

max 


Comp 


p? 


01 i 












1 


.6656 


.1165 


Dynamic Prog 


3.8296 


1.0407 


10 


2 


.6940 


.1022 












3 


.7295 


.0860 


Info Theory 


3.8346 


1 .0340 


8 


4 


,7714 


.0687 












5 


.8179 


.0516 


Seq Halving 


4.4023 


0.2405 


5 


6 


.8661 


.0359 












7 


.9123 


.0223 




n 0 








8 


.9521 


.0117 




1 








9 


.9814 


.0044 


1.0- 




• • • * 






10 


.9970 


.0007 






4 


* 




11 


.9970 


.0007 




i 

• 




• 




12 


.9814 


.0044 


- 


i 




• 




13 


.9521 


.0117 












14 


.9123 


.0223 












15 


.8661 


.0359 












16 


.8179 


.0516 


. 










17 


.7714 


.0687 
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EXAMPLE CASE 7 



Procedure 


E(N) 


V (N ) 


N 

max 


Comp 


p? 


<1 












1 


.6003 


.0781 


Dynamic Prog 


4.0556 


0.3015 


8 


2 


.6012 


.0778 












3 


.6044 


.0768 


Info Theory 


4.0680 


0.5738 


7 


4 


.6136 


.0739 












5 


.6355 


.0673 


Seq Halving 


4.4021 


0.2364 
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EXAMPLE CASE 8 



Procedure 


E(N) 


V (N ) 


N 

max 


Comp 


P i 


p i 












1 


.6000 


.0610 


Dynamic Prog 


4.1859 


0.2347 
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.0610 
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.6000 


.0610 


Info Theory 


4.2036 


0.2689 
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Figure 12 
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EXAMPLE CASE 9 



Procedure 


E(N) 


V ( N ) 


^max 


Comp 


Pi 


Pi 










1 


.8153 


.0738 


Dynamic Prog 


3.9534 


1.1439 
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.0286 
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.9157 


.0300 


Info Theory 


4.0522 


0.9017 
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Figure 13 
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EXAMPLE CASE 10 



Procedure 


E(N) 


V ( N ) 


Dynamic Prog 
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Figure 14 
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EXAMPLE CASE 11 



Procedure 


E(N) 


V (N) 
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Comp 


Pi 
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.9642 
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Figure 15 



EXAMPLE CASE 12 



Procedure 


E(N) 


V (N) 


N 

max 


Comp 


p? 


q i 












1 


.3584 


.1134 


Dynamic Prog 


4.0089 


0.9336 
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2 


.3773 


.1045 
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.3972 


.0961 
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0.9336 
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Figure 16 



EXAMPLE CASE 13 
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E(N) 


V(N) 
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.1215 
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3.8613 


1 .1091 
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.1350 
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.1500 
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3.8613 


1.1091 
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.1667 
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.1852 


Seq Halving 


4.3146 


0.2156 
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6 


.2058 
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.2287 




Pi 
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.2541 
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.2823 


1.0- 










10 


.3137 
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11 


.3486 












12 


.3875 
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13 
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14 
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Figure 17 
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EXAMPLE CASE 14 



Procedure 


E(N) V (N) 


N 

max 


Comp 


Pi 










1 


.0388 


Dynamic Prog 


3.6845 1.1853 


9 


2 


.0456 
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.0537 


Info Theory 


3.6845 1.1853 
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4 


.0632 
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.0743 


Seq Halving 


4.2934 0.2073 
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6 


.0874 
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.1028 
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.1209 


1.0 - 
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.1422 
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E(N) 




V (N) 


^max 


Dynamic Prog 


5.0120 




0.9941 


7 


Info Theory 
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Seq Halving 


5.2636 
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E(N) 




V(N) 


^max 


Dynamic Prog 


5.1987 
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Info Theory 
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Seq Halving 


5.4600 




0.2484 


6 




EXAMPLE 


CASE 


17 




Prnroni | 

i i Uw-wUmi w 


U ( M 




\t ( M\ 
* * 1 % / 


N 

mo a 


Dynamic Prog 
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Seq Halving 


5.4741 
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VI. CONCLUSIONS 



A. MODEL APPLICABILITY 



The assumptions that the system components are in series, and that 
exactly one failure occurs are not as restrictive as they appear at first 
glance. 

1 . Series-Parallel Systems 

In many instances a complex system consisting of series and 



parallel networks can be reduced to an equivalent series system. 
Consider the system shown in Figure 20. Let R. be the a priori 




I U ±=r=ri I I 

U i I 



Series-Parallel System 
Figure 20 



reliability of component i for i=l ,2, . . . ,11 . Suppose the components 
work or fail independently of each other. 

The reliability of an n-component series system is 
n 



J 



since the probability the system works is equivalent to the probability 

that all components work. This is commonly called the "product rule". 

Since (1 -R - ) is the probability component i is failed, 
n 

n (1-R.) is the probability that all components are failed. All 
i=l 1 

components of an n-component parallel system must fail to cause system 
failure, thus 

R = 1 - n (1 -R • ) 

P i = i 1 

is the reliability of a parallel system. 

With the above expressions for R g and R^, the system in 
Figure 20 may now be reduced to an equivalent series system. First, 
components 2 and 3 form a parallel system. They can be replaced by an 
equivalent component I with 

Rj = 1 - (1-R 2 )(1-R 3 ). 

Similarly, components 7 and 8 can be replaced by component 1 1 A in 
series with component 5 with 

r iia = 1 " ( 1 - r 7 )( 1 - r 8 )- 

Now, components 4, 6 and 9, and components 5 and I I A form two series 
systems. Thus the reliabilities of the upper and lower branches of II 
are R^R^Rg and r 5 r jj^ respectively. These two branches form a 
parallel system, so they can be replaced by the equivalent component II 
with 



R H = 1 - (l-WgHl-VW 
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The system has now been reduced to an equivalent series system 
consisting of components 1, I, II, 10 and 11. The model may now be 
employed to derive a test plan for the equivalent system. 

If the failure is located to lie in component I, both components 
2 and 3 are then known to be failed. Should component II be failed, 
its upper and lower branches are then treated as failed series systems 
for which the model is applicable. 

The above procedure to reduce the system to an equivalent series 
system requires a "grouping" of individual components which in turn 
constrains some properties of the total system test plan. Thus, the 
three solution procedures are not claimed to be optimal. 

2. Component Dependence 

The fact that some inter-dependence exists among the components 
of most systems is not to be denied. However, one would expect such 
relationships to be difficult to define at best. It is therefore 
questionable whether the cost required for a correlation study of 
multiple failures would be justified in terms of improvement of results. 

Two or more components may be dependent to such a degree that 
the independence assumption is no longer an acceptable approximation. 

In this case one may still be able to convert the system to consist 
only of independent components. Each set of dependent components may 
be combined into one equivalent component. These equivalent components 
then operate independently in the system. This aggregation over 
dependent components creates a system with independent components, but 
also creates the above-mentioned "grouping" constraints on the test plan. 
This tradeoff is a factor in the determination of the appropriate level 
of aggregation. 
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Once the components are assumed to function independently, even 
moderate system reliabilities yield small probabilities for multiple 
component failures. Consider the case in which the component reliabili- 
ties are all equal, i.e., = R for i=l,...,n. Denote the number 

of failures by X, and note that X is distributed Binomial (n,l -R) . 

Then let 



P 



1 



P{one failure | system down) = 



P(X=1) 

1-P(X=0) 



and, P{multiple failures | system down} = 1 - P-j = Q-j 



System reliability, R g = R n = P(X=0). These quantities for various 
combinations of n and R are shown in Table III. This shows that, 



Example 


n 


R 


p i 




A. 


1 


5 


0.950 


0.90 


0.10 


0.77 


2 


5 


0.975 


0.95 


0.05 


0.88 


3 


10 


0.950 


0.79 


0.21 


0.60 


4 


10 


0.975 


0.89 


0.11 


0.78 



Conditional Failure Probabilities 
for Equal Reliability Case 

Table III 



for example one, the ratio of P-j to 1-P^ is nine to one. An 
increase in component reliabilities (examples one and two) increases 
this ratio. An increase in the number of components, maintaining the 
same component reliability (examples one and three) reduces the ratio, 
but system reliability is also degraded. With an attendant increase 
in component reliability (examples one and four) to retain approximately 
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the same system reliability, the large ratio is preserved. System 
reliabilities of operational equipment are generally high. Thus the 
assumption of a single failed component seems reasonable. 



3. Constrained Maximum Number of Tests 



Should there exist a constraint on the maximum number of tests 
allowed, e.g., for budgetary or physical reasons, this model is not 
appropriate. The author understands that a dynamic programming formu- 
lation for this constrained problem has been developed, but that 
computer CPU time and core storage requirements limit its application 
to small systems. 

For larger systems then, this model can be used to generate 

three solutions from which to choose. Given the maximum number of 

tests n, select that solution from the three for which 
n 

P(N < n) - „ 

i=l 



i-j ivii i# Ui iv- * u i i, i 



B. MERITS OF THE INFORMATION THEORY PROCEDURE 
1 . Expected Number of Tests Required 

For the criterion of minimizing E(N), the information theory 
solution is inferior to that generated by dynamic programming. The 
crucial question is whether the ease of computation of the information 
theory solution can offset its non-optimality. 

Let E(N)-| = E(N) given by dynamic programming, 

E(N) 2 = E (N ) given by information theory, and 
E(N) 2 = E(N) given by sequential halving. 

E(N) i - E(M ) 1 



Define PD. = 



E(H) 



1 



(100) = the percent degradation from the 



optimal solution, for i = 2,3. 
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Over the results of all 20-component example cases, the average 
PD^ = 0.6%, with the maximum PD^ = 2.5% on case 9. Over these same 
cases, the average PD^ = 9.6%, with the maximum PD^ = 56.4% on case 2. 

The 20-component cases for which the component reliabilities 
were selected randomly between 0.7 and 1.0 yielded the largest 
PD 2 values. Three 40-component cases with component reliabilities 
similarly selected were also run. These results, summarized in Table IV, 
indicate that in terms of the E(N) criterion, the information theory 
solution is quite good, at least for up to forty components. Further, 
the PD£ values remained the same order of magnitude when the number 
of components was doubled from twenty to forty. 



Case 


Nr 

Comps 


PD 2 


PD 3 


9 


20 


2.5 


6.3 


10 


20 


2.1 


5.6 


11 


20 


1.1 


4.9 


15 


40 


1.3 


5.0 


16 


40 


1.3 


5.0 


17 


40 


1.6 


6.9 



Random (0. 7-1.0) Case Results 
Table IV 

2 . Maximum Number of Tests Required 

Of all example cases conducted, only in case 5 did N max for 
the information theory solution exceed that of the dynamic programming 
solution. In cases 6, 7 and 8 (all with component reliabilities 
symmetrically arranged), N max for the information theory solution was 
strictly less than that of dynamic programming. For these cases, the 
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first decision d*(l , 20) = 10 appeared to be primarily responsible 
for this result. Note that for symmetrically arranged component 
reliabilities, information theory will always split them in half on 
the first test. One may conjecture here that N, v for the information 
theory solution is likely to be less than or equal to that of dynamic 
programming . 

3. Computation Costs 

The computer program written for the dynamic programming solu- 
tion to the example cases is not claimed to be optimum in terms of the 
CPU time or the core storage required, yet it is believed to be repre- 
sentative of the CPU time and core storage requirements for this 
problem solution technique. 

To obtain an estimate of the relationship between CPU time 



I 1 s4 + U/> 1 | nl k/\>« 

I uOwi I i UU unu Vs I ' V.J | luilims l 



1 . . a. I *! _• L . n _, ........ - 



subroutine SETIME/GETIME was employed. Three cases each were run for 
10, 20 and 40 components and one 80-component case, all with component 
reliabilities randomly selected from 0.7 to 1.0. The CPU times 
required for both calculations and output of results were recorded as 
shown in Table V. The time required for solution calculations heavily 



Nr 


Calculation 




Output 




Comps 


Time(sec) 


Avq 


Time (sec) 


Avq 


10 


0.0346 




0.0300 




10 


0.0334 


0.0340 


0.0316 


0.0310 


10 


0.0341 




0.0313 




20 


0.2514 




0.0592 




20 


0.2410 


0.2457 


0.0543 


0.0570 


20 


0.2448 




0.0574 




40 


1.9635 




0.1234 




40 


1 .9657 


1 .9504 


0.1191 


0.1205 


40 


1.9320 




0.1191 




80 


14.5887 


14.5887 


0.2161 


0.2161 



CPU Time Requirements 
Table V 



dominates the total time required as the number of components is 
increased. Further, as the number of components is doubled, the CPU 
time required for these calculations increases by a multiplicative 
factor of between seven and eight. Accordingly, projected CPU time 
requirements for larger cases are shown in Table VI. 



Nr Projected 

Comps Calculation Time 



160 


102-117 sec. 


320 


12-17 min. 


640 


84-136 min. 



Projected CPU Time Requirements 
Table VI 

Core storage requirements and projected storage requirements 
for larger cases are shown in Table VII. 



Nr 

Comps 


Core Storage 
(Bytes x 1000) 


Nr 

Comps 


Projected 
Core Storage 
(Bytes x 1000) 


10 


45.0 


160 


251 


20 


47.5 


320 


868 


40 


57.5 


640 


3,331 


80 


96.5 







Core Storage Requirements 
Table VII 



As is apparent from Tables VI and VII, core storage requirements 
would be the controlling factor in limiting the maximum number of 
components which could be considered in the dynamic programming computer 
program. 
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The information theory solution procedure is simple enough to 
require only basic desk calculator skill. Forty-component cases 
required about an hour and a half for the author on a desk calculator 
(not including the time required to calculate q-values). The practical 
limits of this solution method are estimated to be at about 100-160 
components. For systems substantially larger the author believes that 
a computer program could be developed which would require far less core 
storage than the dynamic programming solution. Thus, for large systems, 
it may well be the case that information theory and sequential halving 
may provide the "best" alternative solutions. 
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APPENDIX A 



SYSTEM POSTERIOR PROBABILITIES 
A. STATEMENT OF THE PROBLEM 

Given the a priori probabilities that the components are working, 
find the corresponding posterior probabilities given the system has 
exactly one failed component. 



B. DERIVATION 

Define the following: 

p° = a priori probability component i is working. 
q° = 1 - p° = a priori probability component i is failed. 
p.j = 1 - = posterior probability component i is working given 

the system has exactly one failed component. 

{ A^ } = the event component i is working. {A..} is the complementary 
event. 

{ B} = the event exactly one component is failed. 

We wish to find p^ = P(A..|B), i = l,2,...,n. 



p. = P(A.|B) = 1 - P(ff.|B) = 



= 1 - 



Jil 



z 

k=l 



o „ o 

q k n p,- 

K tfk J 



P(A.riB) 

P(B) 



<i = 



0 tt 0 

Pi n Pi 

1 J 



n 

Z 



o „ o 

q k ^ p i 

k=l K j^k J 
n 



and we have that . Z q. = 1. 

i =1 1 



0 ) 



C. COMPUTATIONAL FORM 



To apply the information theory procedure we must first find 
q. for i = l,2,...,n. We seek a form of (1) which is more suitable 
for hand calculations: 



q< = 



IT p 

j 



o n 0 
k 



E q 
k=l K jA 



q? n Pj ° 

1 J?i J 
" qJV(np°) 

k=l K K j J 



q?/P?(n Pj °) 

J 

(np°) £ q°/p° 
j J k=l K k 



q,- = 



„0, 0 

V P 1 



V „ 0 , 0 

E q k /p k 



k=l 



D. ALGORITHM FOR COMPUTATION 

.1. Calculate ck/d? for each comnonent (o? = 1 - n?l 

• i • • i • v « | * * 0 

k \ i * 

2. Sum results of step (1). 

3. Divide each q°/P° from step (1) by the result of step (2). 



APPENDIX B 



INFORMATION THEORY PROCEDURE 



A. DERIVATION 

Define the following: 

U Q = the uncertainty (entropy) present in an n-component system 
known to have exactly one failed component. 

= the uncertainty remaining after one test across the first 
m components. 

q. = posterior probability component i is failed given the 
1 n 

system has exactly one failed component. E q. =1. 

i = l 1 

i* = the number of the failed component. 

Kh i nchi n [1 4] offers the following rationale for the uncertainty 

(entropy) concept in probability theory. A complete system of events 

is a mutually exclusive and exhaustive set of events A, ,A OJ ...,A . 

j 1 2 ’ n 

Given the events of a complete system, together with their probabilities 

n 

of occurrence q^ ,q 2 , . . . ? q n (q^ _> 0, £ q. = 1), we have a finite^ 

scheme . For example, one toss of a true die yields the finite scheme 

{A-j,...,Ag} with A.j = {die shows i}, hence q^ = 1/6 for all i. 

Any finite scheme describes a state of uncertainty in that we don't know 

which of the events A,,..., A will be realized. 

n n 

Define the quantity U(q,,...,q ) = - £ q. In q. as a measure of 

i n i=l 1 1 

the uncertainty inherent in a finite scheme, A^ , . . . ,A , taking 

q. In q. = 0 if q. = 0. In our problem, A. = {component i is failed}, 
n 1 1 

hence U = - I q. In q. . 

0 i=l 1 1 

We wish to maximize the expected reduction in uncertainty at each 
test. Thus, the problem is: 
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max E (U - U ) 

' o nr 

s.t. m = 1,2,... ,n-l 

E (U Q - U m ) = E(U q ) - E(U m ) = U Q - E(U m ) , since U Q is a constant. 
E (U m ) = P(l£i* 5 m)E(Uj 1_< i *<m ) + P(m+l<i*<n)E(U |m+l£i*<n) 



m 



Vi =1 1 



m 

(- 1 ) 2 
j=l 



I q 0 1 


hn 


q j \ 


ra 


m 




f 


q?i q i 1 



E a. 



li =m+l 






(- 1 ) 2 
j=m+l| 



q • 
J 



E q. 
i=m+l 



In 



E q 
i=m+l 



So E(U - U ) 
o 



n 

, - E q. In q. - 

nr i=1 q i q i 



m \ 
E q 

i = l V 



m 



(-1) E 
J = l| 



m 

E q 






i=l 




m 

E q, 



i = l 



/ 



n 

E q 
,i =m+l 



(-1) E 
j=m+l 



q j i 


1 ln 


q i i 


,1 


n 


n 


( 


^i=m+i q ^ 


1 


2 q . j 
i=m+l iy 


1 

J 



m 



E ^ U o - V = 



- E q. In q. + E q. 
1 = 1 1 1 j=l J 



, q i ' 
In' 1 



m 

‘4, q *' 



n 

+ E q.ln 
j=m+l J 



q i \ 



n 

z q i/ 
'i=m+l iy 



n 

Since E q. In q. is a constant, we can simply 
i=l 1 1 



max Q 

m 




n 

E 

j=m+l 



In 




q 



\ 



M 



s. t. m = 1 ,2,. . . ,n-l 



m 


r f m ) 


i 


n 




n 1 


““ 


But Q = 2 q. 


In q. - In 2 q. 




+ 2 q . 


In q . - In 


2 q 




m j=i J 


J 'i 


1 


j=m+l J 


J 


J^m+l j 





n m j 


( m 1 


n 


/ n \ 


= 2 q. In q. - 2 q In 


E ^i 


2 


q. In 2 q. 


j=l J 3 j=l J 1 


j=m+l 


J \i=m+l W 



n 

Again, since 2 q. In q. is a constant, we can reduce the problem to 
j=l J J 

, m / m 

max Q m = - 2 q,- In [ E q. 

m j=l J \i=l 1 

s.t, m = 1 ,2,. . . ,n-l 

m 

Let = P(l£i*<m) = 2 q . . Expression (1) is of the form: 

J 

- P m P m - (1 - P^) ln(l - Pi. Further, P m is an increasing function 

m m ' rrr ' nr m 3 

of m. 

Consider the function 

f(x) = -xln x - (1 - x)ln(l - x), 0 < x < 1. 

Let us maximize f(x) for 0 < x < 1. 

f‘(x) = -In x - 1 - [-In ( 1 -x ) - 1] = 0 
= -In x + In ( 1 -x ) = 0 

= In (-^-) = 0=^x = l-x=£>x = 1/2 

X 

Further, f"(x) = - - - J- < 0, for 0 <x<l. 

X I *- X 

Thus f(x) is concave over (0,1) with a single maximum at x = 1/2. 

From the above concavity argument and the fact that f(x) is sym- 
metric about x = 1/2 , it follows that in order to maximize Q m , and 

consequently to maximize the expected reduction in uncertainty, one 

m 

must choose m such that | 2 q. - 1/2| is a minimum. 

i=l 1 



n 

2 

j=m+l 



q . In 



n 
2 

i i =m+l 



( 1 ) 
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The problem may be formulated in another way which leads to the 
same result. One may consider the amount of information given by the 
realization of a finite scheme to be equal to the entropy of the scheme 
[14], Any test defines a finite scheme with two events, A-j = 

{the test fails) and its complement A-j = (the test passes). The 
information gained from such a test is then 

U = -P(A 1 )ln P (A ] ) - P(A-j )1 n P^). 

But P^) = 1 - P(A ] ) , so 

U = - P (A-j ) 1 n P(A 1 ) - (1 - P(A 1 ))ln (1 - P^)). 

m 

As developed above, P(A-,) = £ q. when testing across the first m 

1 i=l 1 

components. Maximization of U subject to m=l ,2,. . . ,n-l is equivalent 
to expression (1), which now has the interpretation of maximizinq the 
information gained by this test and hence leads to the same result as 
above. 



B. APPLICATION TO SUCCEEDING TESTS 

The above derivation applies for the first test. In all subsequent 
tests, the q-values for the components must be modified to reflect the 
additional knowledge obtained on the system state. Specifically, we 
want q£ , the probability that component k is failed given the 
system is in state S(i,j), for i < k < j. Note that 



% 



r _ M k _ M k 



P[S(1.j)] 3 y „ 

' . q h 
h=i 



> i < k < j , 



which is a normalization of q. such that E q. = 1 . 

K k=i K 
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This yields a "system" consisting of components i through j known 

to contain the defective component. Now, in order to maximize the 

m 

expected reduction in uncertainty, choose m such that | S - 1/2 1 



h=i 



is a minimum. 



C. ALGORITHM FOR COMPUTATION 

The following steps constitute the calculations necessary for test 
plan specification: 

1. Calculate component posterior probabilities of failure, 

for i=l,2,..,,n, using the algorithm of Appendix A. 

2. State S(l,n), Form the partial sums 

k 

Z(k) = Z q. 
i=l 1 

sequentially for k=l,2,..., until Z(k) >0.5 for the first time. Let 

this k = k . Now Z(k Q -l) < 1/2 Z(k ) , and d*(l ,n) = k -1 or k , 

according to the following: 

/ 

k -1, if |Z(k -1) - 1/2| < | Z(k ) - 1/2| 
d*(l ,n) =1 0 0 0 

k Q , if |Z(k o -l) - 1/2| > |Z(k Q ) - 1/2| 

\ 

The first of these conditions becomes 



1/2 - Z(k o -l) < Z(k Q ) - 1/2 
Z(k Q ) + Z(k Q -l) > 1 



and the second condition becomes 



1/2 - Z(k 0 -1) > Z(k Q ) - 1/2 
Z(k Q ) + Z(k Q -l) < 1 
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so, choose d*(l,n) according to the following: 



|k 0 -l, if Z(k o ) + Z(k Q -l) > 1 

|k o , if Z(k Q ) + Z(k Q -l) < 1 



3. Resulting state determination. If at test t, d*(i,j) = k, 
then the two possible resulting states at test t+1 are S(i,k) and 
S(k+1 ,j ) . 

4. State S(i,j). Form the partial sums 

k 

Z(k) = qfj 



sequentially for k=i,i+l,.,., until Z(k) >_ 0.5 for the first time. 
Let this k = k Q . As shown above, choose d*(i,j) according to the 
following: , 



, > if Z(k ; + Z(k-l) > 1 

d*(i,j)=<° 0 0 

k 0 . if Z(k o ) + Z(k Q -l ) < 1 

V 



5. Located failed components. Any test plan must include test 
sequences to locate each component, should that component be the 
defective. If d*(i,j) = i, component i is located. If d*(i,j) = j-1, 
component j is located. Note that d*(i,i+l) = i always and locates 
both components i and i+1 . 

6. Continue steps three through five until all components are 
located. This completes the test plan specification. Brule, Johnson 
and Kletsky[3] have shown that exactly n-1 tests must be specified 
to complete the test plan. 

7. Expected number of tests required. If a test plan requires a 

maximum of t tests, then 
o 
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to 

E(N) = 2 i •P(N=i ) > 
i=l 

where P(N=i) is the sum of the component q-values for all components 
requiring exactly i tests. 

8. Variance of number of tests required. 

V (N) = E(N 2 ) - [E(N)] 2 



= 2° i 2 -P(N=i) - [E(N)] 2 

i=l 



64 



APPENDIX C 



PROPERTIES OF THE SEQUENTIAL HALVING PROCEDURE 

A. MAXIMUM NUMBER OF TESTS REQUIRED 

Let = the cardinality of the set known to contain the failed 
component (the defective set) after t tests have been conducted. 
Express m^. in the form m^. = 2 k ^ + r^ , where k^ e {0,1,...} and 
the remainder term, r^. e (0,1,..., (2 t - 1)}. Initially, there are 

k 

n = m Q = 2 0 + r Q components to be tested. 

Let m* be the maximum number of components which could be in 
the defective set after the t^* 1 test. The t^ test partitions 
the nij. i set into two subsets containing m£ and m£ components 
respectively, such that m^. + m£ = m t _-j and m* = max(m£, m£). 

Let N(n) be the maximum number of tests which indy be required to 
locate the failed component under any sequential testing procedure n. 

Let dj. be the number of components to be tested across on the 
t*^ test. 



Define the sequential halving procedure n* as follows: 

If nij. = 2^t + then divide in the middle so that 

d^ = 2 ^t"l) + [r^/2], where [ r^./ 2] is the greatest integer less 



than or equal to r^/2 . 

k 

Lemma 1 . For a system of n = m Q = 2 0 + r Q components, the 

sequential halving procedure H* yields 

( 



N(n*) =< 



k , for r = 0 
o o 

k Q + 1 , for r Q = l,2,...,(2 k o - 1) 
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Proof . Case I (r =0): m Q = 2 k °. Under n*, d-j = 2 k ° - ^ and 

m-j = 2 k °~\ For the second test d 2 = 2 k °~ 2 and m 2 = 2 k °~ 2 . For 

the third test d^ = 2 k °~ 3 and m 3 = 2 ko ~^. Continue this procedure 

until m. = 2 ^o"^o"l) _ Then w = 2° = 1 and m. =1. 

o K o K o 

Testing is now complete, since the one component remaining must in fact 

be faulty. Therefore, k Q tests are required and N(n*) = k Q . 

Case II (r ^ 0): n = m = 2 k ° + r , where now r e {1 ,2,. . . ,(2 k ° - 
0 0 0 0 

Under n*, d ] = 2 k o _1 + [r Q /2], [r Q /2] e (0,1 , . . . , (2 ko_1 - 1)}. This 

k -1 

test may divide the components into two groups with 2 0 + [r Q /2] 

components in one group and 2 k ° - ^ + [r /2] + 1 components in the other 

k -1 

if r Q is odd, or two groups both with 2 0 + r Q /2 components if 

r is even. In the worse case, 
o 

m* = 2 k o _1 + r Q /2 + 1 

_ /-vkn — 1 ^ f r, /nkr*“! \ 1 

~ ^ *•’ ‘ 1 5 ' 1 ^ L ! > - 5» • • * > V ^ ^ ) S • 

Suppose r 1 = 2 k o" ] . Then ni* = 2 k ° _1 + 2 k ° _1 = 2 k °. 

Under case I, it is shown that k Q further tests are required under 
n*, yielding N (IT* ) = k + 1. 

Suppose alternatively that r-| e{ 1 ,2,. . . ,(2 k °~^-l )}. Then 
m| = 2 k o"^ + r-j , and under n*, d^ = 2 k °~ 2 + [r-j/2], 

Ir 1 /2] e{0,l,...(2 k o" 2 -l)} and 

m* = 2 k °~ 2 + Cr 1 /2] + 1 

= 2 k °" 2 + r 2 , r 2 e{l ,2, . . . , (2 k °~ 2 )} . 

Suppose r 2 = 2 k o' 2 . Then m* = 2 k o" 2 + 2 k o' 2 = 2 k ° _1 . 

Under case I it is shown that k -1 further tests are required under 

n*, yielding N(n*) = k + 1. 



Suppose alternatively that r 2 e{l ,2, . . . , (2 k ° - ^-l )} . Then 
m * = 2 k °~^ + r anc j unc j er jj*, = 2^°"^ + [r 2 /2], 

[r 2 /2] e {0,1,..., (2 k °” 3 -l )} and 



9 



m* = 2 k o" 3 + [r 2 /2] + 1 

= 2 k o" 3 + r 3 , r 3 1,2,..., (2 k °~ 3 ) . 



Continue this procedure until 




= 2° + r 



k 



r. e (l, 2 ,...,( 2 k o- k O)} 



o 



= 1 + 1 = 2 



Then d^ + -| = 1 and m£ + -, = 1 . As in case I above, testing is now 
o o 

complete and N (IT* ) = k^ + 1. 0. f. D. 

B. MINIMAX PROPERTY 

Theorem 1 . Of all dichotomous sequential testing procedures II, 
the sequential halving procedure n* is a minimax procedure. That is, 



Proof . The theorem is true vacuously for n = 1, since no testing 
is required. It is also true for n = 2 and n = 3, since it* is 
the only dichotomous sequential testing procedure to follow. Note here 
that for n = 3, d-j =2 (testing across the first two components) is 
equivalent to testing across the third component which satisfies II*. 

Assume the theorem to be true for n = 1 ,2 , . . . , ( s -1 ) . To show: 

The theorem holds for n = s. 



N (n* ) = m ] | n N(n) 
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Let n = s = 2 k ° + r Q , r Q e {0,1 , . . . , (2 k °-l )} . Any procedure JI 
reduces at each test the number of components in the defective set by 
at least 1. So for any procedure n, m* £ s - 1 . It is assumed that 
the theorem holds for n = 1 ,2,. . . ,(s-l ). Thus n* is the minimax 
procedure to follow after conducting the first test. Therefore, we 
need consider those procedures II 1 which differ from n* only at the 
first test. 

Case I (r =0): s = m Q = 2 °. Under any procedure IT, 

k -1 k 

2 0 +2 <_ m^ £ 2 °-l . Employing n* for subsequent tests yields 
(by Lemma 1): N(n') = k Q +l > k Q = N (n* ) . 

Case II (r f 0): s = m = 2 k ° + r , r e {1 ,2, . . . (2 k o-l )} . 

O O 0 0 

Under any procedure II', 

2 k ° _1 + [r/2] + 2 < m* < 2 k o + r „ - 1 , 

where r Q e (1 ,2 , . . . (2 k °-l )}=£* [r /2] e {0,1 , . . . , (2 k ° _1 -1 )} . 

So, 2 k ° -1 + [r/2] + 2 > 2 k ° _1 + 2, for all r , and 

2 k ° + r - 1 > 2 k °, for all r . Thus, for r / 0 there exists no 
o — o o 

k -1 

procedure IT for which m| < 2 0 +2. Therefore, employing H* 

on subsequent tests yields N (IT ' ) = k Q +l = N(n*) for those procedures 
for which m* < Z k °, and N (n ' ) = k +2 > k +1 = N(n*) for those 

k 

procedures for which m| > 2 o. Q. E. D. 

C. COUNTEREXAMPLE TO MINIMAX PROPERTIES OF "HALF-SPLIT TECHNIQUE" 

As cited in Section II, Bruld, Johnson and Kletsky [3] make two 
claims involving minimax properties of the "half-split technique". 

They claim that it minimizes the maximum possible cost in both the 
equal cost-equal probability and the equal cost-unequal probability 



cases . 



Since the costs are equal for all tests in both cases, we may let 
the cost of a test be unity. Then the maximum possible cost of a 
test plan is simply the maximum number of tests which may be required. 
Let the system consist of 15 components. The "half-split technique" 

k- 

prescribes that if m^. = 2 t + r^. components remain in the defective 

set after t tests, t = 0,1,2,..., then the (t+l) s ^ test must 

partition these components into two groups such that each group 

k+-l 

contains at least 2 z components. One may generate the test plan 
shown in Figure 21, which follows this procedure. Under this plan the 
maximum possible cost is 6. From Lemma 1 above, we know that employing 
the sequential halving procedure will lead to a maximum possible cost 
of 4. Thus the above solution is not minimax. Note also that a 
minimax criterion is independent of component reliabilities. 
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COMPUTER OUTPUT 



COMPONENT 



1 

2 

3 

A 

5 

6 

7 

8 
9 

10 
1 1 
12 
13 
1 A 

15 

16 

17 

18 

19 

20 



P ( I ) 



0.AC50 
C. A350 
0. A650 
0.A950 
0. 5250 
0.5550 
0.5850 
0.6150 
C.6A50 
0.6750 
C. 7050 
C.7350 
0.7650 
C, 7950 
0.8250 
0.3550 
C. 8350 
0.9150 
C. 9A50 
C. 9750 



0 ( 1 ) 



0. 133C 
0.1176 
0. 1CA2 
0.092A 
0.0819 
0.0726 
0.06A2 
0.0567 
0. CA98 
0 .0A36 
0. C379 
0.0326 
0.0278 
C. C233 
0.0192 
0 .0154 
0. 0118 
0.0C8A 
0.0053 
0. CC23 
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OPT I MAI 



SYSTEM STATE 


DECI 


TEST 1 


( I, 20 


5 


TEST 2 


( 1» 5) 


2 


( 6, 20 


9 


TEST 3 


( I, 2) 


1 


( 3, 5) 


3 


( 6, 9) 


7 


( 1C, 20 


1 2 


TEST 4 


( 4, 5) 


4 


( 6, 7 ) 


6 


( 8, 9) 


8 


( 1C, 12) 


10 


( 13, 20 


14 


TEST 5 


( 11, 12) 


1 1 


( 13, 14) 


13 


( 15, 20 


16 


t/- r t / 

1 . • 4 1 


(ip, 1 6 ) 


I 3 


( 17, 20 


17 


TEST 7 


( 18, 20) 


18 


TEST 8 


( 19, 20 


19 



VARIANCE C c NR OF TESTS = 



MIN EXPECTED LOCATED FA RFC 
NR TESTS COMPONENTS 



3.9152 






2.3294 






3.5732 






1.0000 


1 


2 


1.6259 


3 




2.0000 






3. 1860 






1 .0000 


4 


s 


1. 0000 


6 


7 


1.0000 


8 


9 


1.6180 


10 




2.7571 






1.0000 


11 


12 


1.0000 


13 


14 


2.3785 






1.0000 


15 


16 


1 .8497 


17 




1.4744 


18 




1.0000 


19 


20 


0.8517 
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COMPUTER PROGRAM 
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19 CON TIN Ut: 

20 FORMAT (1H , 17X, 13, 13X, Fa. 4. 14X 

CALL OPRCG (N) 



SUBROUTINE C c RDO (N) 
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